Validity of the 15-item five-facet mindfulness questionnaire among an ethnically diverse sample of university students.

OBJECTIVE: This study examines the psychometrics of the 15-item version of the Five-Factor Mindfulness Questionnaire (FFMQ-15). PARTICIPANTS: An ethnically diverse sample of 538 college students participated in this study. METHODS: The factor structure was evaluated through confirmatory factor analyses fitting 64 alternative models with and without method factors. Model fit as well as valid interpretations of the model parameters were considered in selecting the final model. Utilizing the final selected model, the relationship between mindfulness and the mindfulness facets with two related constructs, psychological inflexibility and emotional distress tolerance was examined. RESULTS: The five-facet second-order model with a single-method factor best fitted to the data and provided sound, interpretable estimates. After accounting for the single-method effect, overall mindfulness was positively correlated with emotional distress tolerance and negatively correlated with psychological inflexibility. CONCLUSIONS: The FFMQ-15 was a valid measure of mindfulness among university students when accounting for the method factor.

Investigating method effects associated with the wording direction of items of the Social Physique Anxiety Scale.

PURPOSE: The use of psychometric instruments to measure latent concepts is common. The development of these instruments usually involves mechanisms to reduce response bias, such as the inclusion of reversed items. The aim of this study was to investigate method effects related to the wording direction of the Social Physique Anxiety Scale (SPAS) items, a one-dimensional instrument that assesses individual's level of anxiety when others observe their body. METHODS: In total, 152 Brazilian adults (65.8% female) answered 2 formats of the SPAS: the original with 12 items (7 regular and 5 reversed); and a new format with all items written in the same direction (i.e., regular). Both formats were filled out at different times and alternately. Differential item functioning analysis (DIF) and confirmatory factor analysis were conducted. RESULTS: The original SPAS did not fit the data, but after allowing covariances between all reversed items, the fit improved. The wording effect was supported by the DIF, indicating a better fit to the data for the new format with all items worded in the same direction. CONCLUSION: The wording of the SPAS items had effect on the psychometric properties of instrument. When the wording of the reversed items was modified, the factor model fitted the data. Future studies should take these findings into account and evaluate the SPAS with all items worded in the same direction in different contexts. LEVEL OF EVIDENCE: Descriptive (cross-sectional) study, Level V.

Analysis of the psychometric properties of the Sense of Coherence scale (SOC-13) in patients with cardiovascular risk factors: a study of the method effects associated with negatively worded items.

PURPOSE: The objectives of this study were to analyze the psychometric properties of the Sense of Coherence scale (SOC-13), determine the role of the method effect in the performance of the instrument, and identify the relationship with health perception, quality of life, and sleep quality in patients at cardiovascular risk. METHODS: The final sample consisted of 293 patients at cardiovascular risk, with a mean age of 61.9 years (SD = 8.8), 49.8% of whom were women. The SOC-13, the Patient Health Questionnaire (PHQ-9), and the Medical Outcomes Study-Sleep Scale (MOS-Sleep) were administered. In addition, the participant's self-perceived health and quality of life were also evaluated. All analyses were carried out with SPSS 26.0 and EQS 6.1 statistical software. RESULTS: The results showed adequate reliability for the SOC-13, with a Cronbach's alpha of .789. The fit of the structures was not adequate in any of the cases (.26 to .62 for one factor, .26 to.73 for three factors, .20 to .54 for one second-order factor, and .25, .42, and .54 for three first-order factors). The three structure models showed an improved fit when adding a latent factor resulting from the method effect (.6 to .85 for one factor, .11 to.90 for three factors, and .11 to .96 for one second-order factor). Moreover, positive correlations were found with health perception, perceived quality of life, and perceived sleep quality. CONCLUSION: The SOC-13 is a suitable instrument for patients with cardiovascular risk in Spain, and it is also an indicator of health perception, quality of life, and perceived quality of sleep. Control of the method effect improves the fit of the instrument's structure. As a future direction, it is recommended to conduct new studies in this and other samples and using different versions of the SOC. TRIAL REGISTRATION: International Standard Randomized Controlled Trial Number: ISRCTN76069254, 08/04/2015 retrospectively registered.

A Motivational-Developmental Free Response Assessment Through a Bifactor Lens.

The Motivational-Developmental Assessment (MDA) measures a university student's motivational and developmental attributes by utilizing overlapping constructs measured across four writing prompts. The MDA's format may lead to the violation of the local item independence (LII) assumption for unidimensional item response theory (IRT) scoring models, or the uncorrelated errors assumption for scoring models in classical test theory (CTT) due to the measurement of overlapping constructs within a prompt. This assumption violation is known as a testlet effect, which can be viewed as a method effect. The application of a unidimensional IRT or CTT model to score the MDA can result in imprecise parameter estimates when this effect is ignored. To control for this effect in the MDA responses, we first examined the presence of local dependence via a restricted bifactor model and Yen's Q3 statistic. Second, we applied bifactor models to account for the testlet effect in the responses, as this effect is modeled as an additional latent variable in a factor model. Results support the presence of local dependence in two of the four MDA prompts, and the use of the restricted bifactor model to account for the testlet effect in the responses. Modeling the testlet effect through the restricted bifactor model supports a scoring inference in a validation argument framework. Implications are discussed.

The factor structure of the Working Alliance Inventory short-form in youth psychotherapy: an empirical investigation.

Objective: The Working Alliance Inventory short form (WAI-S) is one of the most commonly used alliance measures with adolescents. Yet, its factor structure has received minimal attention in the youth alliance literature. This study investigated the factor structure of the WAI-S in psychotherapy for adolescent depression and explored its measurement invariance across time, therapeutic approaches and patients' and therapists' perspectives. The existence of method effects associated with the negatively worded items of the scale was also assessed.Method: The setting of this study is the IMPACT trial, a randomized controlled trial assessing the effects of three therapeutic interventions in the treatment of adolescent depression. The WAI-S was completed at 6, 12 and 36 weeks after randomization by 338 adolescents and 159 therapists. Data were analysed using confirmatory factor analysis.Results: The hypothesized Bond-Task-Goal alliance structure was not supported and a general, one-factor model was found to be more psychometrically valid. The existence of a method effect and measurement invariance across time and treatment arms were also found.Conclusions: While the distinction between the specific alliance dimensions is conceptually and clinically interesting, at an empirical level the alliance features of the WAI-S in youth psychotherapy remain strongly intercorrelated.

How Does the Valence of Wording Affect Features of a Scale? The Method Effects in the Undergraduate Learning Burnout Scale.

A combination of both positively and negatively worded items is often employed in a survey to reduce participants' acquiescence bias, but such a combination may hurt the validity of the survey. The current study investigated the effect of valence of wording on participants' (N = 1132) responses to four versions of the Undergraduate Learning Burnout (ULB) scale. The results showed that the valence of wording affected a number of features of the scale. The internal consistency of both the original and the original-reverse versions (consisted of both positively and negatively worded items) was lower than that of the positive-only and the negative-only versions. The original and the original-reverse versions also had more factors than the positive-only and the negative-only versions. The original and the original-reverse versions showed method effects from both the positively and the negatively worded items, and those from the negatively worded items were stronger than those from the positively worded items. The method effects were predicted by participants' subjective well-being and future academic career plans. Together, this study suggests that using a combination of positively and negatively worded items can lead to a predictable response style and significant method effects, which reduce the scale's internal consistency and change the factor structure of the scale.

Rosenberg Self-Esteem Scale: method effect and gender invariance / Escala de Autoestima de Rosenberg: efeito do método e invariância de gênero / Escala de Autoestima de Rosenberg: efecto del método e equivalencia a través de género

This study aimed to evaluate the dimensionality of the Rosenberg Self-Esteem Scale (RSES), by testing the adjustment of eight factorial models: a one-factor and two-factor model and six single-factor models controlling for the method effect associated with the wording of negative and positive items, through the correlated traits-correlated uniqueness (CTCU) and correlated traits-correlated methods (CTCM) approaches. We also tested measurement invariance across gender. A total of 689 participants took part in the study, with ages between 18 and 70 years (M = 25.5; SD = 8.06), mainly females (77.1%), who answered the RSES and sociodemographic questions. The results showed that single-factor models controlling for the effect of negative items alone or positive and negative items together best fit the data. The results also indicated that the RSES is invariant across gender, presenting the same theoretical structure and psychological meaning for men and women. (AU)

O presente estudo objetivou avaliar a dimensionalidade da Escala de Autoestima de Rosenberg (EAR), testando o ajuste de oito modelos fatoriais: unifatorial, bifatorial, e seis modelos unifatoriais controlando-se o efeito do método associado à redação dos itens negativos e positivos através das estratégias correlated traits-correlated uniqueness (CTCU) e correlated traits-correlated methods (CTCM). Ademais, avaliou-se se a EAR é invariante quanto ao gênero. Compuseram a amostra 689 participantes com idades variando entre 18 e 70 anos (M = 25,5; SD = 8,06), sendo a maioria do sexo feminino (77,1%), os quais responderam a EAR e perguntas sociodemográficas. Os resultados indicaram que modelos unifatoriais, controlando-se o efeito do método associado aos itens negativos ou aos itens negativos e positivos conjuntamente, são os mais ajustados aos dados. Observou-se também que a EAR é invariante em relação ao gênero, apresentando a mesma estrutura teórica e significado psicológico para homens e mulheres. (AU)

Este estudio objetivó evaluar la dimensionalidad de la Escala de Autoestima de Rosenberg (EAR), probando el ajuste de ocho modelos factoriales: unifactorial, bifactorial, y seis modelos unifactoriales controlando el efecto del método de redacción de los ítems negativos y positivos a través de las estrategias correlated traits-correlated uniqueness (CTCU) y correlated traits-correlated methods (CTCM). Además, se evaluó si la EAR es equivalente a través de género. La muestra se conformó por 689 personas, con edades variando entre 18 y 70 años (M=25,5, DE=8,06), la mayoría mujeres (77,1%), que respondieron a la EAR y las preguntas sociodemográficas. Los resultados indicaron que los modelos unifactoriales, controlando el efecto del método asociado a los ítems negativos o a los ítems negativos y positivos conjuntamente, son los más ajustados a los datos. Se observó también que la EAR es equivalente a través de género, presentando la misma estructura teórica y significado psicológico para hombres y mujeres. (AU)

Improved Properties of the Big Five Inventory and the Rosenberg Self-Esteem Scale in the Expanded Format Relative to the Likert Format.

Previous research by Zhang and Savalei (2015) proposed an alternative scale format to the Likert scale format: the Expanded format. Scale items in the Expanded format present both positively worded and negatively worded sentences as response options for each scale item; therefore, they were less affected by the acquiescence bias and method effects that often occur in the Likert scale items. The major goal of the current study is to further demonstrate the superiority of the Expanded format to the Likert format across different psychological scales. Specifically, we aim to replicate the findings of Zhang and Savalei and to determine whether order effect exists in the Expanded format scales. Six psychological scales were examined in the study, including the five subscales of the big five inventory (BFI) and the Rosenberg self-esteem (RSE) scale. Four versions were created for each psychological scale. One version was the original scale in the Likert format. The other three versions were in different Expanded formats that varied in the order of the response options. For each scale, the participant was randomly assigned to complete one scale version. Across the different versions of each scale, we compared the factor structures and the distributions of the response options. Our results successfully replicated the findings of Zhang and Savalei, and also showed that order effect was generally absent in the Expanded format scales. Based on these promising findings, we encourage researchers to use the Expanded format for these and other scales in their substantive research.

Is the Factor Observed in Investigations on the Item-Position Effect Actually the Difficulty Factor?

In confirmatory factor analysis quite similar models of measurement serve the detection of the difficulty factor and the factor due to the item-position effect. The item-position effect refers to the increasing dependency among the responses to successively presented items of a test whereas the difficulty factor is ascribed to the wide range of item difficulties. The similarity of the models of measurement hampers the dissociation of these factors. Since the item-position effect should theoretically be independent of the item difficulties, the statistical ex post manipulation of the difficulties should enable the discrimination of the two types of factors. This method was investigated in two studies. In the first study, Advanced Progressive Matrices (APM) data of 300 participants were investigated. As expected, the factor thought to be due to the item-position effect was observed. In the second study, using data simulated to show the major characteristics of the APM data, the wide range of items with various difficulties was set to zero to reduce the likelihood of detecting the difficulty factor. Despite this reduction, however, the factor now identified as item-position factor, was observed in virtually all simulated datasets.

Double dissociation between the neural correlates of the general and specific factors of the Life Orientation Test-Revised.

In this article, we explore the neural correlates of the general and specific factors assessed by the Life Orientation Test-Revised. These factors have been shown to assess general optimism (GO) and a form of self-enhancement akin to unrealistic optimism (SP). Toward our aim, we used a standardized low-resolution brain electromagnetic tomography (sLORETA), which provides electroencephalographic (EEG) localization measures that are independent of recording reference. Resting-EEG and self-report measures of GO and SP were collected from 51 female undergraduates. EEGs were recorded across 29 scalp sites. Anterior and posterior source alpha asymmetries of cortical activation were obtained by using the sLORETA method. On the basis of previous research findings, ten frontal and six parietal regions of interest (ROIs) were derived. Alpha asymmetry in the posterior cingulate (i.e., BA31) was uniquely associated with GO. In contrast, SP was associated with areas of the inferior frontal gyrus (BA44, BA45) and with the left subcentralis area (BA43). Theoretical and practical implications of the findings are provided and discussed.